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These days, Jim Crutchfield is thinking about 
vocabularies—about how humans continuously extend 
our vocabularies to describe new realms of experience. 
His concerns run counter to those espoused by philoso- 
pher Ludwig Wittgenstein early in this century, who 
said that if you don’t know about something, you can't 
talk about it. Crutchfield is more worried about how our 
perception of the world is limited by our vocabularies 
and how we transcend those limitations. “How do you 
extend your vocabulary in a dynamic way? How do you 
teach yourself to see new patterns you 
haven’t seen before?” he asks. 

- This fascination with what he calls 
“pattern discovery” is one of the rea- 
sons Crutchfield spends more time 
hanging out with artists than other sci- 
entists. Like mathematics, art can be 
an iconic substitute for language— 
and at the same time a vocabulary 
unto itself. “In a way, art 1s a theory 
about the way the world looks to 
human beings,” Mitchell 
Feigenbaum told James Gleick, 
author of Chaos: Making A New Science. 
“What artists have accomplished is 
realizing that there’s only a small 
amount of stuff that’s important, and 
then seeing what it was. So they can 
do some of my research for me.” 

Crutchfield says his long-standing 
friendships with many 
artists, including Ned 
Kahn, Sara Roberts, 
and Gail Wight, have 
inspired some of his 
more rigorous scientific 
inquiries. Kahn, with 
whom Crutchfield 


San Francisco 
Exploratortum exhibit, 
Turbulent Landscapes: 
The Natural Forces 
That Shape Our World 
(http://www.explorato- 
rium.edu/complexity), 
creates art installations 
inspired by atmospher- 
ic physics, geology, 
astronomy, and fluid 
motion: flapping flags, 
dust devils, swirling 
streams. 
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top: “Circling. Wave’ Ned Kenn, “Exploratorium, Sa | 
hottom: “Encircled Stream’ by Ned Kahn, ee sos 


During the years Crutchfield was at UC Berkeley, 
Kahn would call him for help on the scientific end of his 
constructions: “Hey, Jim, I've been squirting water into 
a satellite dish, and the vortex detaches frefn the drain. 
What do you think is happening?” Often Kahn’s queries 
would send Crutchfield into his Berkeley physics lab, 
his own curiosity piqued. The artist, meanwhile, was 


looking for a way to put a frame around an active, natur-_ 


al system, then create a way for observers to alter it—in 


effect, manufacturing curiosity to engage ordinary peo- 


ple with nature, science, and art. 
While Kahn formalizes opportuni- 
ties to perceive and effect natural 


the mathematics used to describe 
those phenomena and employs it in 
the design of her anthropomorphic 


at the California Institute of the Arts 
in Valencia, where she also founded 
and now directs the Integrated Media 
Program. 

“Dynamical systems theory me 
lots of useful material for me,” 
Roberts explains. “It’s not that Pm 
interested in looking at the world 
through a dynamical systems filter. 
It’s useful to me as technique.” Much 
of Roberts’ work, including her 1994 
Elective Affinities (based on 
Goethe novella), used 
dynamical systems 
models to drive the 
“emotional engines” of 
multimedia  installa- 
tions. In Elective 
Affinities, the installa- 
tion 
metaphor for the 
dynamics of complex 
human relationships. 

A married couple 
and two close friends 
are riding in a car 
together and, as a result 
of sexual innuendoes 
bandied about at a pic- 
nic from which they’re 
returning, they are 
thinking about betray- 
ing each other. 
characters are projected 
video images in front 


phenomena, Sara Roberts borrows. 


computer programs. Roberts teaches 


the 
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of starvation or thirst, it sends out 


and back seats repre- 
sented by video busts 
on a_ pedestal; the 
scenery outside the car 
rushes away from them | 
on a screen mounted 
on the wall behind. 
Each character runs on 
its own computer and 
owns its own emotional 
program and database 
of thoughts; all four are 
networked. 
Occasionally, one char- 
acter glances at anoth- 
er. That glance alters 
the state of the emo- 
tional engine in the 
other character according to a set of 
rules. “The spectator looking at them 
doesn't see the system in action, but 
when you walk close to each charac- 
ter’s pedestal, you can hear their 
thoughts,” Roberts says. 

Another artist who has worked 
with Crutchfield is Gail Wight of San 
Francisco, who is developing a new 
electronic arts program at Mills 
College. Wight met Crutchfield while 
creating a piece for ‘Turbulent 
Landscapes on biological self-organi- 
zation in dictostelium slime mold. 
Biologists are fascinated with this 
species of slime mold because when a 
dictostelium cell is in danger of dying 


chemical signals to surrounding 
cells—and they aggregate by moving 
in synchronized waves into a slug-like 
creature that forms a budding stalk, 
which explodes, sending spores flying 
to distant, and perhaps more _ hos- 
pitable, environments. 

Wight was supposed to grow dic- 
tostelium as part of _ her 
Exploratorium installation, but the 
spores she was given were a different 
species (physarum) that only grows in tree-like struc- 
tures and does not shift from individual cells to a multi- 
cellular organism—something she did not discover until 
after months of waiting for her slime cells to organize 
into traveling waves. ‘The experience caused her to look 
at science differently, to question her implicit trust, and 
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led to the way she now 
uses science in her 
work—by questioning 
it. “I started being very 
suspicious of my own 
infatuation with sci- 
ence,” she said. “I 
began to wonder, how 
did we get to this place, 
this thing we now call 
science?” 

Her question 1s 
apparent in a_ later 
installation in which 
she put 50 mice in indi- 
vidual cages; their envi- 
ronments illustrated 
moments in the history 
of genetics. One was a portrayal of 
Mendel’s pea garden. Inside the cage 
was a miniature pea garden, which, 
eventually, the mouse ate. Another 
cage illustrated the studies from 
which scientists concluded twins had 
little in common genetically—only to 
later realize that their own biases pre- 
vented them from recognizing the 
twins' shared attributes. One mouse 
in the twin pair had a tiny baby grand 
piano in his cage; he decided to sleep 
inside it. The other had a shabby 
upright piano; he ate the instrument. 

Recently, Wight designed a similar 
installation; this one includes five tiny 
tableaux from history representing 
“how we came to conceive of our- 
selves as electrochemical entities.” Of 
this exhibit, Wight said, “These tiny 
tableaux are sitting inside a square 
Plexiglas maze, and there’s a rat that 
lives inside of it. The rat will hopeful- 
ly eat away the tableaux. The rat is 
sort of the artist.” | 

In the winter of 1998-99, 
Crutchfield organized a public lecture 
series in Santa Fe titled “Arts of the 
Artificial.” Motivated by an interest in 
how art and science will determine the structure of “vir- 
tual spaces” created by networked computers, the series 
included talks by Gail Wight, Roberts, art critic Dave 
Hickey, and Rodney Brooks, director of MIT's Artificial 
Intelligence Lab. | 

The idea of the series was that public exposure to the 
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inspire others toward 


covery at which 


thinking of those on 
the forefront of pat- 
tern discovery in art 
and science might 


similar inquiries. 
Putting artists and sci- 
entists together often 
causes each to recog- 
nize old things in new 
ways—that mysterious 
process of pattern dis- 
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humans are so good. 

Kahn was recently 
working on a geologi- 
cal installation that 
represents a_ slice 
through a_ volcanic 
landscape. Air is ee aS 
pumped up through Se 
two sheets of glass, | , 
fluidizing a powdery semen 
mixture, erupting to ry 
the surface and creat- 
ing a caldera. “When I 
got this working | @& snnulide le 
called this geophysi- 
cist, Raymond Jean- 
Luz, at (UC) 
Berkeley,” Kahn 
recalled. “He was so 
into this thing he 
spent three hours just 
staring at it. He came 
back the next day with 
a graduate student and 
they spent all day star- 
ing at it. [hey were 
looking at something 
real. It reminded them 
of why they got inter- 
ested in geology in the 
first place.” 

Kahn says looking 
at real phenomena 
prompts a different 
kind of thinking. “Your mind 1s working on a lot of lev- 
els. You’re processing this visual information, and you’re 
recognizing patterns, some so subtle you probably can't 
describe what you're seeing, but on some level aesthet- 


ically .. . there's an indication that there is an order in 
there.” 
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That’s similar to what Crutchfield experienced in 
the laboratory during his experiments on video feed- 
back. ‘These were not focused so much on the rich pat- 
terns generated by that system, but on the process of his 
own perception of those patterns. Eventually, this led 
him to develop a mathematical framework to describe 
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SPIRAL DESIGN GENERATED BY JIM CRUTCHFIELD. PHOTOS 


the process of pattern discovery. 
He would be looking at the video 
monitor, thinking, “This pattern 
looks familiar...similar to some- 
thing else I saw a few days ago,” 
he recalls. “The empirical facts 
that I concentrated on were not 
images that appeared on the 
screen but the first intuitive 
impressions of regularity that 
occurred as I began to see new 
patterns.” 

One of the _ projects 
Crutchfield began recently 
involves magnetoencephalogra- 
phy (MEG), a new imaging tech- 
nique that measures neural activ- 
ity via magnetic signals generated 
by the functioning brain—a 
potentially more _ sensitive 
method than the more familiar 
electroencephalography (EEG). 
A clinician typically analyzes such 
data by visual inspection, that is, 
studying temporal information 
recorded on strips of paper or ona 
screen, and recognizing certain 
patterns within the data. 

‘The problem is that the more 
sophisticated MEG machines, 
such as the 122-channel one at 
the Veterans Administration 
Hospital in Albuquerque, pro- 
duce gigabytes of data in just a 
few minutes of recording from a 
subject, more data than a clini- 
cian could ever analyze by eye. 
What's needed is the ability to 
analyze such quantities of data 
for hundreds of people, over 
time, to identify norms and 
anomalies associated with illness. 
“Can we teach a machine to auto- 
matically discover patterns in 
such huge quantities of data?” 
Crutchfield asks. 

In the past, human beings 
have been constrained by the 
limits of our physical world and 
our evolutionary heritage. 
Although it may not be possible 
for the human mind to perceive 
patterns in more than four or five 
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